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ATTENTION: EO/US 

NOTE: To avoid abandonment of the application, the applicant shall furnish to the USPTO, not later than 20 months from 
the priority date: (I) a copy of the international application, unless it has been previously communicated by the 
International Bureau or unless it was originally filed in the USPTO, and (2) the basic national fee (see 37 C.F.R § 
1.492(a)). The 30-month time limit may not be extended 37 C.F.R. § 1.495. 

WARNING: Where the items are those -which can be submitted to complete the entry of the international application into 

the national phase are subsequent to 30 months from the priority date the application is still considered to 
be in the international state and if mailing procedures are utilized to obtain a date the express mail 
procedure of 37 C.F.R. §1.10 must be used (since international application papers are not covered by an 
ordinary certificate of mailing - See 37 C.F.R. §1.8. 

NOTE: Documents and fees must be clearly identified as a submission to enter the national state under 35 USC 371 otherwise 
the submission will be considered as being made under 35 USC 111. 37 C.F.R. § 1.494(f). 



CERTIFICATION UNOER 37 C.F.R. § 1.10* 

(Express Mail label number is mandatory.) 
(Express Mail certification is optional.) 

I hereby certify that this paper, along with any document referred to, is being deposited with the United States Postal Service on this 
date August 3 L 2001 in an envelope as "Express Mail Post Office to Addressee," mailing Label Number EK835032915US, 

addressed to the: Assistant Commissioner for Patents, Washington, D.C. 2023 1 . 

DeannaM. Rivemider 

(type or print name of person mailing paper) 

stature of person mailing paper 

Certificate of mailing (first class) or facsimile transmission procedures of 37 C.F.R § 1.8 cannot be used to obtain a date 
of mailing or transmission for this correspondence. 

Each paper or fee filed by "Express Mail" must have the number of the "Express Mail" mailing label placed thereon 
prior to mailing. 37 C.FR. § 1.10(b). 

"Since tiie filing of correspondence under §1.10 -without the Express Mail mading label thereon is an oversight that can 
be avoided by the exercise of reasonable care, requests for -waiver of this requirement -will not be granted on petition. " 
Notice of Oct 24, 1996, 60 Fed. Reg. 56,439, at 56,442. 



WARNING: 
"WARNING: 
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Applicant herewith submits to the United States Elected Office (EO/US) the following items 
under 35 U.S.C. 371: 

a. [X] This express request to immediately begin national examination procedures (3 5 

U.S.C. 371(f)). 

b. [X] The U.S. National Fee (35 U.S.C. 371(c)(1)) and other fees (37 C.F.R. § 1 .492) 

as indicated below: 



2, Fees 



CLAIMS 


(1) FOR 


(2) NUMBER 


(3) NUMBER 


(4) RATE 


(5) CALCULATIONS 


FEE 




FILED 


EXTRA 






m* 


TOTAL CLAIMS 


10- 20 = 


0 


X $18.00 = 


$0 




INDEPENDENT 


2-3 = 


0 


X $80.00 = 


$0 




CLAIMS 










BASIC 
FEE** 


MULTIPLE DEPENDENT CLAIM(S) (if applicable) + $270.00 


$ 


[ ] U. S. PTO WAS INTERNATIONAL PRELIMINARY 
EXAMINATION AUTHORITY 

Where an International preliminary examination fee as set forth in § 
1 .482 has been paid on the international application to the U.S. PTO: 
[ ] and the international preliminary examination report states 
that the criteria of novelty, inventive step (non- 
obviousness) and industrial activity, as defined in PCT 
Article 33(2) to (4) have been satisfied for all the claims 
presented in the application entering the national stage (37 
CFR 1.492(a)(4)) $96.00 
[ ] and the above requirements are not met (37 CFR 






IX] U.S. PTO WAS NOT INTERNATIONAL PRELIMINARY 
EXAMINATION AUTHORITY 






Where no international preliminary examination fee as set forth 
in § 1.482 has been paid to the USPTO, and payment of an 
intemational search fee as set forth in § 1.445(a)(2) to the U S 
PTO: 






[ ] has been paid (37 CFR 1 .492(a)(2)) $760.00 

[ ] has not been paid (37 CFR 1 .492(a)(3)) $970.00 

fX] where a search report on the international application has 






been prepared by the European Patent Office or the 
Japanese Patent Office (37 CFR 1.492(a)(5)) $860 00 














$860.00 




Total of above Calculations 


= $860.00 


SMALL 
ENTITY 


Reduction by '/2 for filing by small entity, if applicable. Affidavit must be filed, 
(note 37 CFR 1.9, 1.27, 1.28) 


- $ 




Subtotal 


$860.00 




Total National Fee 


$860.00 




Fee for recording the enclosed assignment document $40.00 (37 CFR 1.21(h)). 
(See Item 13 below). See attached "ASSIGNMENT COVER SHEET". 


$ 


TOTAL 


Total Fees enclosed 


$860.00 



*See attached Preliminary Amendment Reducing the Number of Claims. 



[X] A check in the amount of $860.00 to cover the above fees is enclosed. 

[ ] Please charge Account No. in the amount of $ 

A duplicate copy of this sheet is enclosed. 
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miNG: "To avoid abandonment of the application the applicant shall furnish to the United States Patent and 
Trademark Office not later than the expiration of 30 months from the priority date: <* * * (2) the basic 
national fee (see § 1.492(a)). The 30-month time limit may not be extended. " 37 C.F.R. § 1.495(b). 

JNG: If the translation of the international application and/or the oath or declaration have not been 

submitted by the applicant within thirty (30) months from the priority date, such requirements may be 
met within a time period set by the Office. 37 C.F.R. § 1.495(b)(2). The payment of the surcharge set 
forth in § 1.492(e) is required as a condition for accepting the oath or declaration later than thirty (30) 
months after the priority date. The payment of the processing fee set forth in § 1.492(f) is required for 
acceptance of an English translation later than thirty (30) months after the priority date. Failure to 
comply with these requirements will result in abandonment of the application. The provisions of§ 1.136 
apply to the period which is set Notice of Jan. 3, 1993, 1147 O.G. 29 to 40. 

[X] A copy of the International application as filed (3 5 U. S .C . 3 7 1 (c)(2)) : 

Section 1.495 (b) was amended to require that the basic national fee and a copy of the international application 
must be filed with the Office by 30 months from the priority date to avoid abandonment "The International 
Bureau normally provides the copy of the international application to the Office in accordance with PCT Article 
20. At the same time, the International Bureau notifies applicant of the communication to the Office In 
accordance with PCT Rule 47.1. that notice shall be accepted by all designated offices as conclusive evidence that 
the communication has duly taken place. Thus, if the applicant desires to enter the national stage, the applicant 
normally need only check to be sure the notice from the International Bureau has been received and then pay the 
basic national fee by 30 months from the priority date. " Notice of Jan. 7. 1993, 1147 O. G. 29 to 40, at 35-36. See 
item 14c below. 



[ ] is transmitted herewith. 

[ ] is not required, as the application was filed with the United States Receiving 
Office. 

[X] has been transmitted 

i. [X] by the International Bureau. 

Date of mailing of the application (from form PCT/IB/308): . 

ii. [ ] by applicant on 



[X] 



A translation of the International application into the English language (35 U S C 
371(c)(2)): ^ ' 

[X] is transmitted herewith. 

[ ] is not required as the application was filed in English. 

[ ] was previously transmitted by applicant on 



[ ] 



will follow. 



[X] Amendments to the claims of the International application under PCT Article 1 9 (3 5 
U.S.C. 371(c)(3)): 



The Notice of January 7. 1993 points out that 37 C.F.R. § 1.495(a) was amended to clarify the existing and 
continuing practice that PCT Article 19 amendments must be submitted by 30 months from the priority date and 
this deadline may not be extended. The Notice further advises that: "The failure to do so will not result in loss of 
the subject matter of the PCT Article 19 amendments. Applicant may submit that subject matter in a preliminary 
amendment filed under section 1.121. In many cases, fding an amendment under section 1.121 is preferable since 
grammatical or idiomatic errors may be corrected. "1147 O. G. 29-40, at 36. 

a. [ ] are transmitted herewith. 

b. [ ] have been transmitted 

i- [ ] by the International Bureau. 
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Date of mailing of the amendment (from form PCT/IB/308): 

ii. [ ] by applicant on , 

Date 

c. [X] have not been transmitted as 

i- [X] applicant chose not to make amendments under PCX Article 19. 

Date of mailing of Search Report (from form PCT/ISA/2 1 0): 18/08/2000 
[ ] the time limit for the submission of amendments has not yet expired. 
The amendments or a statement that amendments have not been 
made will be transmitted before the expiration of the time limit 
under PCX Rule 46.1. 



[X] A translation of the amendments to the claims under PCX Article 1 9 (3 8 U S C 

371(c)(3)): 
a. [ ] is transmitted herewith. 

[ ] is not required as the amendments were made in the English language. 

[X] has not been transmitted for reasons indicated at point 5(c) above. 

[X] A copy of the mtemational examination report (PCX/IPEA/409) 
[X] is transmitted herewith. 

[ ] is not required as the application was filed with the United States Receiving 
Office. ^ 



[ ] Annex(es) to the international preliminary examination report 
a. [ ] is/are transmitted herewith. 

[ ] is/are not required as the application was filed with the United States 
Receiving Office. 

[ ] A translation of the annexes to the international preliminary examination report 
a- [ ] is transmitted herewith. 

^- [ ] is not required as the annexes are in the English language. 

[X] An oath or declaration of the inventor (35 U.S.C. 371(c)(4)) complying with 35 

a- [ ] was previously submitted by applicant on _^ 



Date 

[ ] is submitted herewith, and such oath or declaration 

i- [ ] is attached to the application. 

[] identifies the application and any amendments under PCX Article 19 
that were transmitted as stated in points 3(b) or 3(c) and 5(b); and 
states that they were reviewed by the inventor as required by 37 
C.F.R. 1.70. 

iii. [X] will follow. 



II. Other document(s) or information included: 



[X] An International Search Report (PCX/ISA/2 1 0) or Declaration under PCX Article 
17(2)(a): 

a. [X] is transmitted herewith. 

b- [ ] has been transmitted by the International Bureau. 

Date of mailing (from form PCT/IB/308): 

^- [ ] is not required, as the application was searched by the United States 

International Searching Authority. 
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[ ] will be transmitted promptly upon request. 
[ ] has been submitted by applicant on 



[X] An Information Disclosure Statement under 37 C.F.R. 1 .97 and 1 .98: 

a. [X] is transmitted herewith. 

Also transmitted herewith is/are: 

[XI Form PTO-1449 (PTO/SB/08A and 08B). 

[X] Copies of citations listed. 

b. [ ] will be transmitted within THREE MONTHS of the date of submission of 

requirements under 35 U.S.C. 371(c). 

c. [ ] was previously submitted by applicant on . 

Date 

[ ] An assignment document is transmitted herewith for recording. 

A separate [ ] "COVER SHEET FOR ASSIGNMENT (DOCUMENT) ACCOMPANYING 
NEW PATENT APPLICATION" or [ ] FORM PTO 1595 is also attached. 



[X] 


Additional documents: 


a. 


[X] 


Copy of request (PCT/RO/101) 


b. 


[X] 


International Publication No. WO 00/5293 1 






[X] Specification, claims and drawing 




ii. 


[ ] Front page only 


c. 


[ ] 


Preliminary amendment (37 C.F.R. § 1.121) 


d. 


[X] 


Other 



Preliminary Amendment, Forms PCT/IB/304, PCT/IB/306, International Preliminary 
Examination Report, English translation of the amended pages filed under Art. 34 
PCT (Armex to the International Preliminary Examination Report). 



[X] The above checked items are being transmitted 

a. [X] before 30 months from any claimed priority date. 

b. [ ] after 30 months. 

[ ] Certain requirements under 35 U.S.C. 371 were previously submitted by the 
applicant on ^ namely: 



AUTHORIZATION TO CHARGE ADDITIONAL FEES 

WARNING: Accurately count claims, especially multiple dependent claims, to avoid unexpected high charges if extra 

claims are authorized. 

NOTE: "A written request may be submitted in an application that is an authorization to treat any concurrent or future 
reply, requiring a petition for an extension of time under this paragraph for its timely submission, as 
incorporating a petition for extension of time for the appropriate length of time. An authorization to charge all 
required fees, fees under §1.17, or all required extension of time fees will be treated as a constructive petition for 
an extension of time in any concurrent or future reply requiring a petition for an extension of time under this 
paragraph for its timely submission. Submission of the fee set forth in § 1.1 7(a) will also be treated as a 
constructive petition for an extension of time in any concurrent reply requiring a petition for an extension of time 
under this paragraph for its timely submission. " 27 C.F.R. § 1.136(a)(3). 
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NOTE: "Amounts of twenty-five dollars or less will not be returned unless specifically requested within a reasonable 

time, nor will the payer be notified of such amounts; amounts over twenty-five dollars may be returned by check 
or, if requested, by credit to a deposit account. "37 C.F.R. § ]. 26(a). 

[X] The Commissioner is hereby authorized to charge the following additional fees that 
may be required by this paper and during the entire pendency of this application to 
Account No. 04-1105. 

[X] 37 C.F.R. 1 .492(a)( 1 ), (2), (3), and (4) (filing fees) 

WARNING: Because failure to pay the national fee within 30 months without extension (37 C.F.R. § 1. 495(b)(2)) 
results in abandonment of the application, it would be best to always check the above box. 

[X] 37 C.F.R. 1 .492(b), (c) and (d) (presentation of extra claims) 

NOTE: Because additional fees for excess or multiple dependent claims not paid on filing or on later presentation must 
only be paid or these claims cancelled by amendment prior to the expiration of the time period set for response by 
the pro in any notice of fee deficiency (37 C.F.R § 1.492(d)), it might be best not to authorize the PTO to charge 
additional claim fees, except possible when dealing with amendments after final action. 

[X] 37 C.F.R. 1 .17 (application processing fees) 
[X] 37 C.F.R. 1.17(a)(l)-(5)(extension fees pursuant to § 1.136(a). 
[ ] 37 C.F.R. 1.18 (issue fee at or before mailing of Notice of Allowance, 
pursuant to 37 C.F.R. 1 .3 1 1(b)) 

NOTE: Where an authorization to charge the issue fee to a deposit account has been filed before the mailing of a Notice 
of Allowance, the issue fee will be automatically charged to the deposit account at the time of mailing the notice 
of allowance. 37 C.F.R. § 1.311(b). 

NOTE: 37 C.F.R. 1.28(b) requires "Notification of any change in loss of entitlement to small entity status must be filed in 
the application . . . prior to paying, or at the time of paying . . . issue fee. " From the wording of 37 C.F.R. § 
1.28(b): (a) notification of change of status must be made even if the fee is paid as "other than a small entity" and 
(b) no notification is required if the change is to another small entity. 

[ ] 37 C.F.R. § 1.492(e) and (f) (surcharge fees for filing the declaration and/or 
filing an English translation of an International Application later than 30 
months after the priority date). 




/SIGNATURE OF PRACTITIONER 



Peter F. Corless 

(type or print name of practitioner) 

EDWARDS & ANGELL, LLP 

Dike, Bronstein, Roberts & Cushman, IP Group 

P.O. Box 9169 

P.O. Address 

Boston. MA 02209 



Reg. No.: 33,860 



Tel. No.: (617)523-3400 
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Docket No. 56426 
IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

APPLICANT: M. Brett et al. 

EXPRESS MAIL LABEL: EL 835032915US 
FILED: HEREWITH 

FOR: METHOD AND CIRCUIT FOR PICTURE-IN-PICTURE 

SUPERIMPOSITION 

THE HONORABLE COMMISSIONER OF PATENTS AND TRADEMARKS 
WASHINGTON, DC 20231 

SIR: 

PRELIMINARY AMENDMENT 

Applicants file herewith the above-identified application. Please amend the application 
as follows. 

IN THE CLAIMS 

Please cancel claims 1-10 without prejudice. 

Please add the following new claims. 

11. A method for picmre-in-pictore insertion, in which a sequence of decimated 
inset pictures is written to a memory device and is read out for insertion into a sequence of 
main pictures, 

wherein inset pictures are written to the memory device in a circulating manner as fields 
under continuously incremented write addresses, the inset pictures being written to 
corresponding memory segments beginning at corresponding writing start addresses, 
in that the vmting start address of each written-in field is stored, 

in that, each time the write address is incremented, by comparison of the respective 
instantaneous write address with a previously stored writing start address, an overtake signal is 
formed which indicates whether the respective writing start address is reached again and the 



M. Brett et al. 
Page 2 



memory segment corresponding to the respective writing start address is overwritten, 

in that, by evaluation of the overtake signal, the memory segment corresponding to the last 

writing start address stored or the penultimate writing start address stored is selected for read-out, 

and 

in that the selected memory segment is read out for insertion into the respective main 
picture with continuously incremented read addresses. 



12. The method of claim 1 1 wherein the write and read addresses are continuously 
incremented from a first memory address up to a last memory address and are in each case reset 
to the first memory address again after the last memory address has been reached. 

1 3 . The method of clami 1 1 wherein in order to insert an inset picture into a main 
picture, in a segment buffer for two inset pictures, the picture position and size are in each case 
stored in the form of a number of lines and also pixels per line. 

14. The method of claim 1 1 wherein the raster correction is effected by comparison 
between the raster position of a picture to be displayed and the raster position of a stored picture 
and also by skipping or repeating a line. 



15. The method of claim 1 1 wherein each time the write address is incremented, the 
instantaneous write address is compared with the penultimate writing start address stored and, in 
the event of correspondence, the last writing start address stored is used as reading start address 
for reading the corresponding memory segment, whereas otherwise the penultimate writing start 
address is used as reading start address for reading the corresponding memory segment. 
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16. A circuit arrangement for inserting a sequence of decimated inset pictures into a 
sequence of main pictures, comprising: 

a write controller for writing the inset pictures as fields under continuously incremented 
write addresses to corresponding memory segments of a memory device beginning at 
corresponding writing start addresses, 

having a segment buffer for storing the writing start address of each field written to the 
memory device, in which case an overtake signal can be generated by the write controller each 
time the write address is incremented, by comparing the respective instantaneous write address 
with a previously stored writing start address, which overtake signal indicates whether the 
respective writing start address is reached again and the memory segment of the memory device 
which corresponds to the respective writing start address is overwritten, 
having a display controller to which the overtake signal is fed, in which case the display 
controller can select, by evaluating the overtake signal, the memory segment corresponding to 
the last writing start address stored or the penultimate writing start address stored, for read-out by 
a read controller, coimected to the segment buffer, with the aid of continuously incremented read 
addresses and for insertion into the respective main picture. 

17. The circuit arrangement of claim 1 6 wherein the write controller and the read 
controller each have an address counter for incrementing the write addresses and read addresses, 
respectively. 

1 8 . The circuit arrangement of claim 1 6 wherein, by means of the display controller, 
an insertion position of an inset picture is calculated and a corresponding insertion signal can be 
fed to an msertion apparatus. 

1 9. The circuit arrangement of claim 16 wherein, by means of the display controller, 
raster correction can be carried out by comparison between the raster position of a picture to be 
displayed and the raster position of a stored picture and also by skipping or repeating a line. 
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20. The circuit arrangement of claim 1 6 wherein provision is made of a comparator 
for comparing the instantaneous write address provided by an address counter with the 
penultimate writing start address stored, the output of the comparator being connected to a flip- 
slop for driving a multiplexer, and 

in that the penultimate writing start address stored is present at a first input of the multiplexer and 
the last writing start address stored is present at a second input of the multiplexer, with the result 
that, in the event of correspondence between the instantaneous write address of the address 
counter and the penultimate writing start address stored, the multiplexer outputs the last writing 
start address stored as reading start address, whereas otherwise the multiplexer outputs the 
' ;;{ penuhimate writmg start address stored as reading start address. 



REMARKS 

J j To reduce initial filing fees, claims 1-10 have been cancelled without prejudice, and 

s clauns 11-20 have been added. No new matter has been added by virtue of the new clauns . 
'■■ ■ For instance, support for the new clarnis appears e.g. in the origmal claims of the application. 

Early consideration and allowance of the application are earnestly solicited. 



Respectfully submitted, 

Peter F. Corless (Reg. 33,860) 

Dike, Bronstein, Roberts & Cushman IP Group of 

EDWARDS & ANGELL, LLP 

P.O. Box 9169 

Boston, MA 02110 

Telephone: (617) 523-3400 



GR 99 P 1352 
Description 



Method and circuit arrangement for picture-in-picture 
insertion 

The invention relates to a method for picture-in- 
picture insertion, in which a sequence of decimated 
inset pictures is written to a memory with at least two 
segments and is read out for insertion into a sequence 
of main pictures, to be precise in accordance with the 
preamble of claim 1, and also a circuit arrangement for 
picture-in-picture insertion, in particular for 
carrying out said method in accordance with the 
preamble of claim 6. 



Various methods and apparatuses for inserting one or 
more inset pictures into a main picture (PIP - Picture 
In Picture) are known. In this case, the inset pictures 
stored in the memory are read out synchronously with a 
main picture. Since the read-out speed is generally 
higher, in a manner corresponding to the decimation of 
the inset picture, than the write-in speed, a seam can 
occur in the inset picture on account of the write 
pointer being overtaken by the read pointer, since the 
inset picture is then composed of a current part and a 
preceding part. 



In particular in the case where the two parts originate 
from different motion phases, a disturbing effect is 
produced since moving objects through which the seam 
passes are displayed in a distorted manner. Moreover, 
if the frequencies of the inset and main pictures do 
not correspond exactly, the seam drifts, which is 
perceived as particularly unpleasant. 

EP 0 739 130 A2 discloses, for the purpose of avoiding 
this problem, storing two inset pictures (or fields in 
each case) in the memory device, so that it is always 
the case that exactly one picture can be read out while 
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the next picture is written. Although this prevents the 
write pointer from being overtaken by the read pointer, 
there is nonetheless a significant disadvantage in that 
the storage capacity must be very high, which is 
associated with considerable costs. 

The invention is based on the object, therefore, of 
providing a method and also a circuit arrangement for 
picture-in-picture insertion of the type mentioned in 
the introduction by means of which, with relatively low 
outlay, an inset picture can be generated without a 
seam. 

This object is achieved by means of a method which is 
distinguished by the fact that: 

the inset pictures are written to the memory 
device in a circulating manner under continuously 
incremented write addresses, 

the first address of each written-in inset picture 
is stored, 

an overtake signal is formed by comparing the 
instantaneous address with a previously stored address, 
said signal indicating whether a previous address has 
been reached again and, consequently, the corresponding 
picture content has been overwritten, 

by evaluation of the overtake signal, the current 
or preceding segment is selected for read-out depending 
on whether or not overtaking took place before the 
start of the read- out, and 

the inset picture stored in the selected segment 
IS read out with continuously incremented read 
addresses and is inserted into the main picture. 

The object is furthermore achieved by means of a 
circuit arrangement for inserting a sequence of 
decimated inset pictures into a sequence of main 
pictures, which has a memory device having at least two 
segments for the inset pictures, a write controller and 
a read controller and which is distinguished in 
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particular by the fact that an overtake signal that can 
be fed into a display controller can be generated by 
the write controller, in that a segment buffer is 
provided, which segment buffer is connected to the read 
5 controller and serves to store a first and a last 
address of an inset picture, and in that a memory 
segment to be read out by the read controller can be 
selected by means of the display controller in a manner 
dependent on the overtake signal . 

10 

The solutions according to the invention are based on 
the insight that the write pointer can be prevented 
from being overtaken by the read pointer through 
suitable circulating addressing of the memory device in 
15 a manner utilizing the speed difference between the 
pointers. A significant advantage of this solution is 
that this holds true even when the size of the inset 
picture changes. Furthermore, is also not necessary to 
provide completely separate memory areas for reading 

2 0 and writing or to adapt the organization of the memory 

to the inset-picture size. 

The subclaims contain advantageous developments of the 
invention . 

25 

Accordingly, for example, the write and read addresses 
are continuously incremented from a first memoory 
address up to a last memory address and are in each 
case reset to the first memory address again after the 

3 0 last memory address has been reached. 

For this purpose, in the circuit arrangement according 
to the invention, it is preferably provided that the 
write controller and the read controller each have an 
3 5 address counter for incrementing the write addresses 
and read addresses, respectively. 

Further details, features and advantages of the 
invention emerge from the following description of 
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preferred embodiments with, reference to the drawings, 
in which: 

Figure 1 shows a block diagram of a circuit 
arrangement according to the invention; 

Figure 2 shows a diagram of the signal profiles when 
writing to a picture memory; 

Figure 3 shows a diagram of the signal profiles when 
reading from a picture memory; 

Figure 4 shows a representation for illustrating the 
origination of a seam; 

Figure 5 shows a diagram of the signal profiles 
according to the invention; 

Figure 6 shows a block diagram of a circuit 
arrangement for selecting a memory segment; 

Figure 7 shows an address pointer representation in 
the absence of vertical decimation; 

Figure 8 shows a representation of memory division in 
the absence of vertical decimation, and 

Figure 9 shows a representation of the memory outlay 
in the case of decimation. 

In accordance with Figure 1, a main picture signal is 
fed to a circuit arrangement according to the invention 
via a first input A, and an inset picture signal is fed 
via a second input B. The inset picture signal passes 
to a decimation device 1 and also to a synchronization 
device 8. The picture signal of the inset picture, 
which is generally vertically decimated, is buffer- 
stored in the form of fields in a memory 2 and, after 
read-out, is fed together with the main picture signal 
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to an insertion apparatus 3, which generates a 
composite picture signal. 

The synchronization device 8 is connected to the 
decimation device 1 via a first output and to a write 
controller 4 via a second output. A first output of the 
write controller 4 is connected to the memory 2, while 
a second output is connected to a segment buffer 7 and 
a third output is connected to a display controller 6. 
The output of the segment buffer 7 is connected to a 
read controller 5, to which a first output of the 
display controller 6 is also fed. An output of the read 
controller 5 is connected to the memory 2. Finally, a 
second output of the display controller is fed to the 
insertion apparatus 3, the display controller having an 
input C for synchronization signals of the main 
picture. 



In order to write to the memory 2 an inset picture 
signal that has been decimated by the decimation device 
1, the write controller 4 generates the required 
addresses. In the simplest case, given an e.g. linear 
organization of the memory 2, the write address pointer 
is incremented after each write operation. If the 
address pointer reaches the last address, it is reset 
to the first address, under which the writing process 
IS continued, this being done over the duration of the 
field with interruptions in accordance with the 
decimation. In this case, a preceding picture (field) 
is inevitably overwritten. 

With each beginning of a new field, the first write 
address is stored in the segment buffer 7, which 
additionally stores the last address as well. 
Furthermore, the field position and size are also 
stored in the form of lines and pixels per line in the 
segment buffer 7, the data respectively stored last not 
being overwritten. The storage capacity of the segment 
buffer 7 is thus about double said data to be stored 
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for a field, which in each case corresponds to a field 
in an instantaneous segment and a current segment in 
the memory 2 . 

Each time the write pointer is incremented, the write 
controller 4 additionally checks whether the new 
address has a specific offset, with respect to the 
previously stored (not with respect to the currently 
stored) address. This offset may also be zero in the 
case of a high vertical decimation factor. It serves 
essentially as a safety margin in order to avoid 
overtaking as a result of asynchronous data acceptance 
or slightly deviating vertical frequencies. With this 
offset, an overtake signal is generated which indicates 
whether the address has been reached again and hence 
this picture content has been overwritten. 

The content of the segment buffer 7 is transferred to 
the read controller 5, by means of which the memory 2 
is read beginning at one of the two addresses present 
after the start of reading at the insertion position, 
so that the inset picture can be generated in 
accordance with its position and size in the main 
picture by the insertion apparatus 3 . 

On the basis of the overtake signal transmitted by the 
write controller 4, the display controller 6 decides 
which of the two segments present in the memory 2 is 
read out. The selection of the segment initially always 
proceeds from the last segment. If overtaking took 
place before the start of reading, then the 
instantaneous (current) segment is read out. A 
corresponding segment selection signal is transmitted 
to the read controller 5. 

The insertion position is also calculated by means of 
the display contr-oller. The display controller 6 
furthermore serves for correcting the raster positions, 
this being effected by comparison between the raster 
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position of a displayed picture and the raster position 
of a stored picture and skipping or repetition of a 
line. Finally, the display controller 6 can also be 
utilized for multi-picture insertion. 

Before the algorithm is described in detail, firstly 
the terms used in this context will be explained. 

As was explained above, the decimated pixels of the 
inset picture are firstly stored in the memory 2. For 
display purposes, they are read from the memory again 
in the temporal framework of the main picture. For this 
purpose, the write and read addresses have to be 
generated by separate address counters . 

Figure 2 shows the corresponding signal profiles when 
writing to the memory 2. The instantaneous value of the 
write address counter represents a write pointer with a 
decimated inset pixel in the memory 2 . The terms "write 
pointer" and "read pointer" shall be used for this 
reason. 



An acquisition window (vaqwin) begins with a pulse 
(vaqstart) , and the write address pointer rises with 
each decimated pixel. Since only the visible part of 
the inset picture is decimated, the write address 
pointer rests whenever there is no valid line available 
from the vertical decimation stage. After the last line 
to be decimated, the pointer is reset to the start 
position. The picture of a ramp with shoulders results 
in the representation. 

Figure 3 shows the corresponding signal profiles when 
reading from the memory 2. The instant at which a start 
signal (vdisstart) must be generated in order to begin 
reading from the memory 2 is calculated by means of the 
display controller 6 on the basis of the desired 
insertion position of the decimated inset picture in 
the main picture. With each line of the main picture. 
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at the corresponding insertion position (hdisstart) , a 
line of the decimated inset picture is then read from 
the memory and inserted into the main picture (video 
mux) . 

The picture of a ramp with shoulders once again results 
in the representation of the read address pointer. The 
ramps of the read and write address pointers differ in 
respect of their average gradient. The latter will be 
considered in detail below since it represents the rate 
at which a number of memory cells are swept over within 
a specif ic .period of time. 

The speed of the write address pointer changes with the 
decimation factor, to be precise in such a way that the 
ramp of the write address pointer becomes less steep as 
the decimation factor rises . 

Figure 4 shows the origination of a seam for the case 
of representation in the frame mode. If only a field 
memory is present and the inset picture has been 
decimated, the write pointer is generally overtaken by 
the read pointer. Since the sources for the inset 
picture { "insert_f ield" ) and the main picture 
("parent_field") are generally asynchronous with 
respect to one another, a seam is thus produced, in 
Figure 4, this is indicated by the point of 
intersection between the relatively slow write pointer 
and the read pointer that overtakes the latter, the 
upper-case letters A, B designating the raster position 
of the inset picture and the lower-case Greek letters 
designating the raster position of the main 
picture . 

From a temporal standpoint, the current field is read 
before the seam, while part of an older picture is 
reproduced after the seam. It should be noted in this 
case that, as a result of the line interlacing method 
(interlaced mode), the raster position changes in the 
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event of overtaking, and this subsequently has to be 
corrected again. 

The seam becomes very clearly visible in particular 
5 when a moving picture is displayed, that is to say when 
the current picture and the older picture contain 
different motion phases. If different standards are 
used for the main picture and the inset picture, then 
rolling of the seam occurs. As a result of different 

10 frame frequencies, the combination of the raster 
positions at the beginning of the representation 
changes a number of times every second. It is a very 
complicated procedure to perform a correction in a 
manner dependent on this incorrect position. Moreover, 

15 the picture can be very erratic in the vertical 
direction and be perceived as unpleasant. 

The method according to the invention and the circuit 
arrangement according to the invention now allow, in 
2 0 particular in the frame mode, a seamless representation 
of pictures that have been decimated to different 
extents, without two separate field memories having to 
be available. 

2 5 For the explanations below, it will be assumed that 

orthogonal memory division has been chosen. As a 
result, the memory is divided into lines with fixed 
start addresses. The length of such a line in the 
memory is determined by the largest picture. 

30 

Furthermore, it will be assumed that the inset picture 
and the main picture are present in the same standard. 
The two picture sources can be asynchronous but, in 
terms of their time frame, should initially have no 

3 5 deviations from one another. If the inset picture is 

not decimated vertically and horizontally, one field 
memory suffices for generating a seamless picture-in- 
picture representation, since the two address pointers 
cannot overtake one another on account of their 
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identical speed. The case of raster position correction 
forms an exception. This correction is performed in the 
first line given a corresponding combination of main 
and inset picture positions. 

In this case, the read address pointer jumps by one 
line. In the course of this jump, the situation where 
the write address pointer is overtaken must be 
prevented. This is achieved in that there is space for 
two additional lines in the memory. 

Furthermore, suitable control of the memory accesses is 
necessary. The memory is written to with the fields in 
a circulating manner. As a result, with each new field, 
the start address is shifted by the number of 
additionally present lines in the direction of lower 
physical addresses. If the physical end address of the 
memory is reached in the course of writing, then a jump 
is made back to the start address. 

Figure 5 shows the corresponding signal profiles during 
write control (a) and read control (b) . Accordingly, 
there is thus always somewhat more than one inset field 
in the memory. In a similar manner to the case of the 
organization of two field memories, in this case, too, 
the write address pointer determines the memory segment 
enable. The signals "vaqstart", "vaqwin", "vdisstart" 
and ''hdisstart" again have the same meaning as in 
Figures 2 and 3. 

Figure 5 shows a block diagram for selecting the 
respectively valid memory segment. The circuit 
comprises an address counter 12, whose output is 
connected to a first register 10 and to a first input 
of a comparator 14, a second register 11, to whose 
input the output of the first register 10 is connected, 
and also a multiplexer 13, whose first input 
(line_adr_next ) is connected to the output of the first 
register 10 and whose second output is connected to the 
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output of the second register 11. This latter output is 
also connected to a second input of the comparator 14, 
whose output is connected to a flip-flop 15. 

For control of the read accesses, the start addresses 
of the old and new inset fields are stored in the 
registers 10, 11. With the beginning of a new field, 
the older of the two register contents is rejected, and 
the formerly new start address becomes the old address, 
while the present current address becomes the new start 
address. If the beginning of the older inset field has 
been overwritten as a result of the memory being 
written to in a circulating manner, it can no longer be 
read. 

For selection of the valid memory segment, the content 
of the address counter 12 ( line_address ) is continually 
compared with the start address of the older of the two 
fields (line_address_cur) in the comparator 14. In the 
event of correspondence, the flip-flop 15 is set and 
the start address of the new field is then present at 
the output of the multiplexer 13. If a new field is 
begun, then the flip-flop is reset, and, as a result of 
the change of the register contents, the same start 
address as before is present at the output of the 
multiplexer 13, until this is also overwritten again. 
In this way, the memory enable points to a valid memory 
segment at every instant. The memory space that is 
additionally present means that the read pointer cannot 
reach or overtake the write pointer even in the event 
of a jump on account of the raster position correction. 

In order to satisfy the general requirements, however, 
this sequence must be extended. Considerable deviations 
from the standard can occur particularly in the case of 
video recorders which are operated with fast forward or 
rewind with picture reproduction. In this case, by way 
of example, it is also necessary to take account of the 
maintenance state and the wear of the tape material. 
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The memory control must be able to compensate for the 
effects of a stretched tape and also synchronism 
fluctuations of the drive mechanism. However, a 
precondition in this case is that the sync pulse 
separation still operates correctly in the case of such 
a sicfnal . 

The vertical frequency fv and the horizontal frequency 
£h are related through the number Z of lines as 
follows : 

fv = fH / Z (5.1) 

The line frequencies of the main picture (fap) and of 
the inset picture (fHi) are of interest for the 
algorithm. Their fluctuations directly affect the 
writing and reading speed. The larger the line 
frequency fm of the inset picture, the more memory 
content is written per unit time. The smaller the line 
frequency fnp of the main picture, the fewer lines are 
read per unit time. The opposite correspondingly holds 
true . 

If the same standard is used in both sources, then the 
following relationships hold true, where fn is the 
desired line frequency. 

fHi.max = fn (1 + dfHi) (5.2) 
fHi_min = fH (1 + dfHi) (5.3) 
fnp.max = fH (1 + dfnp) (5.4) 

fHp_r,un = fH (1 + dfnp) (5.5) 

It will additionally be assumed that no vertical 
picture decimation is performed. Since the sources are 
again two sources that are asynchronous with respect to 
one another, write and read pointers can adopt any 
desired position with respect to one another. Equally, 
the pointers can overtake one another in both 
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directions given corresponding combination of the 
horizontal frequencies. 

Figure 7 shows the memory lines reqiiired for the 
respective write and read pointers, where Zacq is the 
number of picture lines of a field that are used for 
acquisition. The representation makes it clear how many 
lines must additionally be present in the memory in 
order to prevent overtaking of the pointers in both 
directions . 

Zs2 = Zacq { ( f Hi_max " f Hp_min ) / f Hi_max ) (5.6) 
Zsl = Zacq { (fHp_max " f Hi_tiu.n ) / f Hp_max } (5.7) 

The total amount of additionally required memory for 
the seamless picture-in-picture representation turns 
out to be: 

Zg = Zacq + Zsi + Zs2 (5.8) 

During writing, the memory contains part of an old 
field and part of a new field. Through the position of 
the write address pointer, one of the two fields is 
enabled for reading. If fewer than Zsi lines of the new 
field have been written, the old field is enabled. 
Otherwise, the distance from the beginning of the old 
field is less than Zs2 lines, with the result that the 
new field can be read. 

Figure 8 shows the memory division in the case where no 
vertical decimation is performed. 

If decimation is then effected in the horizontal and 
vertical direction, this influences the speed of the 
write address pointer. The corresponding relationships 
are shown in Figure 9. The rise of the ramp is smaller 
in this figure. 
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It will initially be assumed that the writing speed 
changes to a considerable extent as a result of the 
decimation. By contrast, the fluctuations due to 
changes in the line frequency shall be small. 

5 

It follows from this that the read pointer can no 
longer be overtaken by the write pointer on account of 
the speed difference. As a result, the memory outlay 
for seamless picture-in-picture representation can now 
10 be determined using the decimation factors and the 
fluctuation range of the picture sources. 

Zsl_dec (deCver) = ( Zacq/deCvgr ) ( 1 - f Hi_mindeCver / f Hp_inax ) 

(5.9) 

15 

The additional requirement of lines decreases as the 
decimation factor increases. The maximum emerges for a 
vertical decimation factor deCver of 1 (vertically 
undecimated picture) . 

20 

The possibility of the read pointer being overtaken by 
the write pointer will now also be taken into account. 
For small vertical decimation factors, the result is a 
further additional memory requirement of: 

25 

Zs2_dec = (Zacq/deC^er) (l-fHp_min deCver/fHi_max) (5.10) 

For a meaningful result, the expression in the right- 
hand brackets must be positive. The validity of this 
30 expression is thus limited to a range of: 

'^1" less than equal to "deCver" less than equal to 

^MfHi_raax/fHp_min) " (5.11) 

35 For values which are greater than the right-hand limit, 
Zs2_dec shall be set to zero. 

Taking account of the validity ranges, the additional 
memory requirement results from the sum of Zsi_ciec and 
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Zs2_dec- The examinations made at the beginning are a 
special case for a vertical decimation factor of 1. 

The total memory requirement consequently turns out to 
be: 

Zg(decver) = Zacq/decver + Zsi_ciec + Zs2_dec for 1 less than 
equal to "deCver" less than equal to ''fai max/fep mm) " 

(5.12) 

thus resulting in the following: 

Zg(deCver) = Zacq/deCver (3 - fHp_mxn cleCver / f Hi_max " 

f Hi_min/ ( de Over f Hp_maK ) (5.14) 

Otherwise, the following holds true: 

Zg(deCver) = Zacq/deCver + Zgi^dec for 

"decver" greater than " ( f Hi_max/f Hp_min) " (5.13) 
The following results from this: 

Zg(deCver) = Zacq/deCver (2 - fHi_min/ (deC^er f Hp^max ) 
(5.15) 

The total number of memory cells required has its 
maximum for a vertical decimation factor of 1. As the 
decimation factor increases, the memory cell 
requirement greatly decreases. 

It shall also supplementarily be pointed out that when 
the memory 2 is extended to three segments, the method 
according to the invention can also be employed with a 
frame frequency of 100 Hz in the AABB raster. 
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PCT/DEOO/00681 
Patent claims 

1. A method for picture-in-picture insertion, 
in which a sequence of decimated inset pictures is 
5 written to a memory device (2) and is read out for 
insertion into a sequence of main pictures, 
characterized 

in that the inset pictures are written to the memory 
device (2) in a circulating manner as fields^ under 

10 continuously incremented write addresses, the inset 
pictures being written to corresponding memory segments 
beginning at corresponding writing start addresses, 
in that the writing start address of each written-in 
field is stored, 

15 in that, each time the write address is incremented, by 
comparison of the respective instantaneous write 
address with a previously stored writing start address, 
an overtake signal is formed which indicates whether 
the respective writing start address is reached again 

20 and the memory segment corresponding to the respective 
writing start address is overwritten, 

in that, by evaluation of the overtake signal, the 
memory segment corresponding to the last writing start 
address stored or the penultimate writing start address 
25 stored is selected for read-out, and 

in that the selected memory segment is read out for 
insertion into the respective main picture with 
continuously incremented read addresses. 

30 2. The method as claimed in claim 1, 

characterized in that the write and read addresses are 
continuously incremented from a first memory address up 
to a last memory address and are in each case reset to 
the first memory address again after the last memory 

35 address has been reached. 
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3. The method as claimed in claim 1 or 2 , 
characterized in that, in order to insert an inset 
picture into a main picture, in a segment buffer (7) 
for two inset pictures, the picture position and size 

5 are in each case stored in the form of a number of 
lines and also pixels per line. 

4 . The method as claimed in one of the preceding 
claims , 

10 characterized in that raster correction is effected by 
comparison between the raster position of a picture to 
be displayed and the raster position of a stored 
picture and also by skipping or repeating a line. 

15 5. The method as claimed in one of the preceding 
claims, 
characterized 

in that, each time the write address is incremented, 
the instantaneous write address is compared with the 

20 penultimate writing start address stored and, in the 
event of correspondence, the last writing start address 
stored is used as reading start address for reading the 
corresponding memory segment, whereas otherwise the 
penultimate writing start address is used as reading 

25 start address for reading the corresponding memory 
segment . 

6. A circuit arrangement for inserting a sequence of 
decimated inset pictures into a sequence of main 
30 pictures, 

having a write controller (4) for writing the inset 
pictures as fields under continuously incremented write 
addresses to corresponding memory segments of a memory 
device (2) beginning at corresponding writing start 
35 addresses, 
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having a segment buffer (7) for storing the writing 
start address of each field written to the memory 
device (2), in which case an overtake signal can be 
generated by the write controller (4) each time the 
5 write address is incremented, by comparing the 
respective instantaneous write address with a 
previously stored writing start address, which overtake 
signal indicates whether the respective writing start 
address is reached again and the memory segment of the 
10 memory device (2) which corresponds to the respective 
writing start address is overwritten, 

having a display controller (6) to which the overtake 
signal is fed, in which case the display controller (6) 
can select, by evaluating the overtake signal, the 

15 memory segment corresponding to the last writing start 
address stored or the penultimate writing start address 
stored, for read-out by a read controller (5) 
connected to the segment buffer (7) - with the aid of 
continuously incremented read addresses and for 

20 insertion into the respective main picture. 

7. The circuit arrangement as claimed in claim 6, 
characterized in that the write controller (4) and the 
read controller (5) each have an address counter (12) 

25 for incrementing the write addresses and read 
addresses, respectively. 

8. The circuit arrangement as claimed in claim 6 or 
1 r 

30 characterized in that, by means of the display 
controller (6), an insertion position of an inset 
picture is calculated and a corresponding insertion 
signal can be fed to an insertion apparatus (3) . 

35 9. The circuit arrangement as claimed in one of 
claims 6 to 8, 
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characterized in that, by means of the display 
controller (6), raster correction can be carried out by 
comparison between the raster position of a picture to 
be displayed and the raster position of a stored 
5 picture and also by skipping or repeating a line. 



10. The circuit arrangement as claimed in one of 

claims 6-9, 

characterized 

10 in that provision is made of a comparator (14) for 
comparing the instantaneous write address provided by 
an address counter (12) with the penultimate writing 
start address stored, the output of the comparator (14) 
being connected to a flip-slop (15) for driving a 

15 multiplexer (13) , and 

in that the penultimate writing start address stored is 
present at a first input of the multiplexer (13) and 
the last writing start address stored is present at a 
second input of the multiplexer (13) , with the result 

20 that, in the event of correspondence between the 
instantaneous write address of the address counter (12) 
and the penultimate writing start address stored, the 
multiplexer (13) outputs the last writing start address 
stored as reading start address, whereas otherwise the 

25 multiplexer (13) outputs the penultimate writing start 
address stored as reading start address. 
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